Examining the Social Validity of the Double Check Online Program: Helping to Scale-up Professional Development for Culturally Responsive Practices.

This paper presents social validity findings from a mixed-methods study of educators who used a recently adapted online version of the research-based Double Check culturally-response practices and student engagement program. Results from 41 participants indicated that the program was easy to use, prompted them to reflect on their own culture, and that they would continue using the website. Although most users reported they would recommend the program, participants indicated they would like a wider variety of examples and more guidance for novice teachers. Additional conclusions and recommendations for improving Double Check and other online teacher professional development programs are discussed.

Stakeholder-driven transformative adaptation is needed for climate-smart nutrition security in sub-Saharan Africa.

Improving nutrition security in sub-Saharan Africa under increasing climate risks and population growth requires a strong and contextualized evidence base. Yet, to date, few studies have assessed climate-smart agriculture and nutrition security simultaneously. Here we use an integrated assessment framework (iFEED) to explore stakeholder-driven scenarios of food system transformation towards climate-smart nutrition security in Malawi, South Africa, Tanzania and Zambia. iFEED translates climate-food-emissions modelling into policy-relevant information using model output implication statements. Results show that diversifying agricultural production towards more micronutrient-rich foods is necessary to achieve an adequate population-level nutrient supply by mid-century. Agricultural areas must expand unless unprecedented rapid yield improvements are achieved. While these transformations are challenging to accomplish and often associated with increased greenhouse gas emissions, the alternative for a nutrition-secure future is to rely increasingly on imports, which would outsource emissions and be economically and politically challenging given the large import increases required.

Collateral effects of Coping Power on caregiver symptoms of depression and long-term changes in child behavior.

A large body of research demonstrates positive impacts of the Coping Power Program as a preventive intervention for youth behavioral outcomes, but potential collateral effects for caregivers is less known. The current study examined whether the youth-focused Coping Power Program can have a secondary impact on caregiver self-reported symptoms of depression and in turn result in longer-term impacts on child disruptive behavior problems including aggression, conduct problems and hyperactivity. Data from 360 youth/caregiver pairs across 8 waves of data (grades 4 through 10) were analyzed. We used two methodological approaches to (a) assess indirect effects in the presence of potential bidirectionality using timepoint-to-timepoint dynamic effects under Autoregressive Latent Trajectory modeling and (b) estimate scale scores in the presence of measurement non-invariance. Results showed that individually delivered Coping Power (ICP) produced greater direct effects on conduct problems and indirect effects on general externalizing and hyperactivity (through reductions in caregiver self-reported symptoms of depression), compared to group Coping Power (GCP). In comparison to GCP, ICP produced similar direct effects on reductions in caregiver depression. Child-focused prevention interventions can have an indirect impact on caregiver depression, which later shows improvements in longer-term reductions for child disruptive problems.

Responsible Behavior With Younger Children: Results From a Pilot Randomized Evaluation of a School-Based Child Sexual Abuse Perpetration Prevention Program.

Many efforts to prevent child sexual abuse (CSA) aim to teach children strategies for recognizing, resisting, and reporting victimization. There is limited evidence that victimization-focused efforts actually prevent CSA. Moreover, these efforts often overlook the fact that many children and adolescents engage in problem sexual behavior against younger children. Responsible Behavior with Younger Children (RBYC) is a novel universal school-based perpetration-focused intervention that aims to prevent the onset of inappropriate, harmful, or illegal sexual behavior by adolescents against younger children.1 Responsible behavior with younger children was designed to provide adolescents and their parents with the knowledge and tools to help adolescents interact appropriately with younger children and avoid CSA behaviors. In this paper we describe intervention development, summarize lessons learned from implementing RBYC in four urban schools, and report results from our pilot randomized waitlist-controlled trial (RCT) with 160 6th and 7th grade students. Results indicate RBYC was associated with increased accuracy in youth knowledge about CSA and CSA-related laws, and with increased behavioral intention to avoid or prevent CSA with younger children and peer sexual harassment. Although the sample was small and the effects were relatively modest, the findings do suggest that RBYC holds promise for preventing the onset of problem sexual behavior.

Revisiting the Percentage of K-12 Students in Need of Preventive Interventions in Schools in a "Peri-COVID" Era: Implications for the Implementation of Tiered Programming.

As the public health framework has been implemented in schools through multi-tiered systems of support, as in Positive Behavioral Interventions and Supports (PBIS), a prominent interpretation has been that 80% of students will benefit from universal or Tier 1 schoolwide behavior support, around 15% will require added selective or Tier 2 targeted support, and 5% will require the more intensive selective or Tier 3 intervention. The PBIS framework also emphasizes the use of tiered logic, with strengthened efforts at the universal and selective levels when student behavioral or mental health needs exceed expected levels. The prediction that 5% of students will require indicated support was based mostly on students at risk for discipline encounters (i.e., office discipline referral data) and, more recently, systematic screening data, but this percentage remains an interpretation of the public health framework. Further, epidemiologic data over the past decade show that rates of childhood mental health disorders have risen and are even higher now as schools struggle to recover from the COVID-19 pandemic-much higher than 15% and 5% for selective and indicated levels. Thus, we believe it is time to revisit projections of the number of students in need of Tier 2 and Tier 3 support. In this position paper, we review the evidence for escalating youth mental health needs and discuss the implications for the tiered prevention framework in schools. We describe strategies to expand the availability of preventive intervention supports beyond Tier 1 efforts and conclude with recommendations for practice, policy, and research in this peri-COVID recovery era.

Introduction to the Special Issue on Innovations and Applications of Integrative Data Analysis (IDA) and Related Data Harmonization Procedures in Prevention Science.

This paper serves as an introduction to the special issue of Prevention Science entitled, "Innovations and Applications of Integrative Data Analysis (IDA) and Related Data Harmonization Procedures in Prevention Science." This special issue includes a collection of original papers from multiple disciplines that apply individual-level data synthesis methodologies, including IDA, individual participant meta-analysis, and other related methods to harmonize and integrate multiple datasets from intervention trials of the same or similar interventions. This work builds on a series of papers appearing in a prior Prevention Science special issue, entitled "Who Benefits from Programs to Prevent Adolescent Depression?" (Howe, Pantin, & Perrino, 2018). Since the publication of this prior work, the use of individual-level data synthesis has increased considerably in and outside of prevention. As such, there is a need for an update on current and future directions in IDA, with careful consideration of innovations and applications of these methods to fill important research gaps in prevention science. The papers in this issue are organized into two broad categories of (1) evidence synthesis papers that apply best practices in data harmonization and individual-level data synthesis and (2) new and emerging design, psychometric, and methodological issues and solutions. This collection of original papers is followed by two invited commentaries which provide insight and important reflections on the field and future directions for prevention science.

The discipline gap in context: The role of school racial and ethnic diversity and within school positionality on out-of-school suspensions.

Disparities in exclusionary discipline practices are well-documented; however, variation in Black students' disciplinary experiences across different racial and ethnic school compositions remains understudied. Utilizing a state-wide dataset (N = 769,050 students in J = 1296 schools), we examined student- and school-level factors that contribute to suspensions for Black students across schools with varying racial and ethnic diversity. Consistent with prior research, we found that Black students were disproportionately suspended more often, for more days, and more likely for soft offenses. We also found that students in majority Black schools (i.e., those where >50% of the students were Black) had the highest unadjusted rates of suspension. However, when controlling for multiple other student- and school-level characteristics, including overall suspension rates, we found that Black students attending majority White schools had a higher adjusted risk of suspension than in majority Black or heterogenous diverse schools, suggesting higher rates of differential treatment in White majority schools. We discuss the implications of these results and the role school psychologists play in supporting professional development, training, and data-based decision making to reduce disproportionality.

Predicting implementation of the PAX Good Behavior Game + MyTeachingPartner interventions.

Introduction: Effective classroom management is critical to creating a classroom environment in which social, emotional, and academic learning can take place. The present study investigated the association between early career, early elementary teachers' occupational health (job stress, burnout, and perceived teaching ability) and perceptions of program feasibility in relation to their implementation dosage and quality of two evidence-based classroom management programs implemented together: the PAX Good Behavior Game (GBG) and MyTeachingPartner (MTP) intervention. Methods: Teachers provided information on their occupational health at the start of the school year and were then randomized to the PAX GBG + MTP condition or control condition. Teachers' perceptions of the feasibility of the program, implementation dosage, and implementation quality of the intervention were measured at the end of the school year for the 94 intervention teachers. Results: Teachers participated in more MTP coaching cycles when they reported that the combined PAX GBG + MTP program was feasible. Although there were no main effects of occupational health on implementation, the associations between job stress and implementation quality were moderated by perceptions of feasibility. Discussion: Findings highlight the complexity of factors influencing the implementation of evidence-based programs in school settings.

Harmonizing Social, Emotional, and Behavioral Constructs in Prevention Science: Digging into the Weeds of Aligning Disparate Measures.

While integrative data analysis (IDA) presents great opportunity, it also necessitates a myriad of methodological decisions related to harmonizing disparate measures collected across multiple studies. There is a lack of step-by-step methodological guidance for harmonizing disparate measures of latent constructs differently conceptualized or operationalized across studies, such as social, emotional, and behavioral constructs often utilized in prevention science. The current paper addressed this gap by providing methodological guidance and a case illustration focused on harmonizing measures of disparately conceptualized and operationalized constructs. We do so by outlining a five-phased harmonization approach paired with an illustrative example of the approach as applied to harmonization of broadband latent emotional and behavioral health constructs assessed with different measures across studies. This approach builds on and expands upon procedures currently recommended in the IDA literature with parallels to best practices in test development procedures. The illustrative example of our phased approach is drawn from an IDA study of 11 randomized controlled trials of Coping Power (Lochman & Wells, 2004), an evidence-based preventive intervention. We demonstrate the harmonization of two constructs, internalizing and externalizing problems, as harmonized across the teacher-reported scales of the Achenbach System of Empirically Based Assessment (Achenbach, 1991a) and the Behavior Assessment System for Children (Reynolds & Kamphaus, 2004). Finally, we consider the potential strengths and limitations of this phased approach, underscoring areas for future methodological research and conclude with some recommendations.

Gender, Racial, and Socioeconomic Disparities on Social and Behavioral Skills for K-8 Students With and Without Interventions: An Integrative Data Analysis of Eight Cluster Randomized Trials.

Despite decades of concern about disparities in educational outcomes for low SES students and students of color, there has been limited rigorous study of programmatic approaches for reducing these disparities in elementary or middle schools. We conducted integrative data analysis (IDA) of the combined data from eight Institute of Education Sciences funded cluster randomized trials to address the research gaps on social and behavioral outcome disparities. The final analytic sample includes 90,880 students in varying grade levels from kindergarten to grade 8 in 387 schools in 4 states (Maryland, Missouri, Virginia, and Texas). Two-level hierarchical linear modeling was used for multilevel moderation analysis. This study provided empirical evidence that there were significant gender, racial, and socioeconomic disparities on social and behavioral outcome measures for elementary and middle school students, the disparities significantly varied across schools, and the disparities could be reduced by interventions. We discussed our findings, implications for interpreting effect sizes of interventions using disparities as empirical benchmarks, and study limitations. We concluded with suggestions for future research.

Interactional quality in middle schools: Latent profiles and their associations with teacher, classroom, and school compositional factors.

High quality teacher-student interactions are critical for the healthy social-emotional, behavioral, and academic development of middle school students. However, few studies have explored patterns of teacher-student interactions in middle school classrooms or the relation between teacher-, classroom-, and school-level factors and patterns of interaction. The current study employed latent profile analyses (LPA) to identify patterns of teacher-student interactional quality in a sample of 334 teachers from 41 schools serving middle school students within the Mid-Atlantic region of the U.S. Three distinct profiles of teacher-student interactional quality were identified that were characteristic of higher, lower, and intermediate quality and were differentially related to teacher, classroom, and school characteristics. Compared to classrooms with lower interactional quality, classrooms with "higher" or "intermediate" profiles were more likely to be taught by early career teachers, to have higher rates of observed student cooperation, and to be in schools in rural fringe areas. Classrooms with lower interactional quality were more likely to have larger student-to-teacher ratios and higher rates of student disruptive behaviors than classrooms with intermediate interactional quality and to be in schools with a higher percentage of out-of-school suspensions than classrooms with higher interactional quality. These findings suggest that interventions at the teacher, classroom, and school levels may promote positive teacher-student interactions, such as consultation to support teachers' effective classroom management, alternatives to out-of-school suspensions, and smaller student-to-teacher ratios.

Teachers Supporting Teachers: A Social Network Perspective on Collegial Stress Support and Emotional Wellbeing Among Elementary and Middle School Educators.

School mental health practitioners and researchers are increasingly concerned about educator job-related stress and its implications for teacher burnout, teaching efficacy, turnover, and student outcomes. Educators' collegial networks in their schools are natural resources for stress support, yet little is known about the extent to which educators seek support from their colleagues in managing their stress and whether these relationships promote their emotional wellbeing. Utilizing peer nomination and self-report data from 370 educators in 17 elementary and middle schools, we found patterns in whom educators nominated as a source of stress support. Specifically, educators more often nominated colleagues who worked in the same role, grade, and/or subject, and those similar in age and who had similar or more experience. Furthermore, men and educators of color more often nominated same-gender and same-race colleagues, respectively, whereas these trends were not observed for women or White educators. However, the prevalence of these characteristics among colleagues nominated as a source of stress support was not often significantly associated with educators' stress and burnout. Rather, educators' level of burnout was positively related to the burnout among those in their stress support networks. In addition, educators' stress and burnout were positively related to the stress and burnout of their colleagues with whom they spent the most time. These findings highlight how educators' perceptions of stress and burnout may be shared within their collegial networks and have implications for a role for colleagues in teacher stress-reduction and wellbeing-focused interventions.

Exploring profiles of coaches' fidelity to Double Check's Motivational Interviewing-embedded coaching: Outcomes associated with fidelity.

Motivational interviewing (MI) is applied in a variety of clinical and coaching models to promote behavior change, with increasing interest in its potential to optimize school-based implementation fidelity. Yet there has been less consideration of fidelity indicators for MI-embedded coaching and their associations with outcomes. We leveraged exisiting data from 151 teachers across 18 schools, who were part of a larger 39 middle school randomized controlled trial of a teacher coaching model, to explore profiles of fidelity and the associations between fidelity and outcomes. We conducted latent profile analysis (LPA) to examine profiles of four components of fidelity (i.e., adherence, dosage, quality, and teachers' responsiveness). Next, we examined whether observed teacher practices and student behaviors varied across fidelity profiles. Because coaches and independent coders reported adherence, we also examined the reliability of retrospective coach adherence ratings. Results indicated that coaches show promise as a reliable rater of adherence. The LPA indicated that there were two (high and lower) fidelity profiles. Statistically significantly fewer instances of student non-cooperation were observed in classrooms where the teacher was engaged in high fidelity coaching, reflecting a large effect size. Moderate-sized, but non-statistically significant, effects also emerged for teacher opportunities to respond and reactive behavior management. We identify concrete areas to ensure that reliability can be achieved in other contexts. Future directions are also considered regarding fidelity measurement and how to optimize coaching.

Is it more effective or efficient to coach teachers in pairs or individually? A comparison of teacher and student outcomes and coaching costs.

A growing body of research documents the positive impacts of teacher coaching, but research contrasting the effectiveness of different coaching approaches is limited. This study contrasted paired coaching - delivered to two teachers simultaneously - with traditional coaching for individual in-service teachers. We examined the effects of these two approaches on observations of teachers' classroom management practices and student behavioral outcomes, relative to non-coached conditions, over the course of a single school year and at a 1-year follow-up. We also explored the relative time and cost efficiency of the two approaches. Two hundred fifty-two teachers from 18 elementary and middle schools participated in the randomized controlled trial. Hierarchical linear modeling was used to account for repeated measures nested within teachers and teachers within schools. Combined effects indicated improved global ratings by observers of teacher behavior management (∆ = 0.29) after a multiple comparison adjustment. Paired coaching was less effective than individual coaching at improving some observed student behaviors, although these did not remain significant after multiple comparison adjustments. Neither model demonstrated sustained effects after one year. Although the paired coaching was significantly more efficient for coach time, it represented just a modest overall cost savings per school. Results indicate a need for more research to identify feasible coaching approaches yielding sustainable effects.

The Sampling Ratio in Multilevel Structural Equation Models: Considerations to Inform Study Design.

Multilevel structural equation modeling (MSEM) allows researchers to model latent factor structures at multiple levels simultaneously by decomposing within- and between-group variation. Yet the extent to which the sampling ratio (i.e., proportion of cases sampled from each group) influences the results of MSEM models remains unknown. This article explores how variation in the sampling ratio in MSEM affects the measurement of Level 2 (L2) latent constructs. Specifically, we investigated whether the sampling ratio is related to bias and variability in aggregated L2 construct measurement and estimation in the context of doubly latent MSEM models utilizing a two-step Monte Carlo simulation study. Findings suggest that while lower sampling ratios were related to increased bias, standard errors, and root mean square error, the overall size of these errors was negligible, making the doubly latent model an appealing choice for researchers. An applied example using empirical survey data is further provided to illustrate the application and interpretation of the model. We conclude by considering the implications of various sampling ratios on the design of MSEM studies, with a particular focus on educational research.

School Climate and Bullying Bystander Responses in Middle and High School.

Bullying bystanders' reactions are important for either stopping or perpetuating bullying behaviors. Given school-based bullying programs' focus on bystanders, understanding the associations between school-level factors and individual bystander responses can improve intervention efficacy. Data from 64,670 adolescents were used to examine bullying bystander responses as a function of 13 school-climate dimensions within 3 main factors (Engagement, Environment, Safety) and individual-level factors (e.g., race/ethnicity, perceptions of student-teacher connectedness). Multi-level models showed schools with better Engagement and Safety had higher odds of defender behaviors, a better Environment was associated with lower odds of passive and assisting behaviors. Differences also varied by individual-level factors. For example, an aggressive climate was associated with passive behaviors more strongly in boys and high schoolers. Further, higher perceived parent-teacher and student-teacher connectedness were associated with positive bystander behaviors, and this was stronger for Black and Latinx youth, highlighting the importance of improving relationships as a crucial starting point.

Transparent, Open, and Reproducible Prevention Science.

The field of prevention science aims to understand societal problems, identify effective interventions, and translate scientific evidence into policy and practice. There is growing interest among prevention scientists in the potential for transparency, openness, and reproducibility to facilitate this mission by providing opportunities to align scientific practice with scientific ideals, accelerate scientific discovery, and broaden access to scientific knowledge. The overarching goal of this manuscript is to serve as a primer introducing and providing an overview of open science for prevention researchers. In this paper, we discuss factors motivating interest in transparency and reproducibility, research practices associated with open science, and stakeholders engaged in and impacted by open science reform efforts. In addition, we discuss how and why different types of prevention research could incorporate open science practices, as well as ways that prevention science tools and methods could be leveraged to advance the wider open science movement. To promote further discussion, we conclude with potential reservations and challenges for the field of prevention science to address as it transitions to greater transparency, openness, and reproducibility. Throughout, we identify activities that aim to strengthen the reliability and efficiency of prevention science, facilitate access to its products and outputs, and promote collaborative and inclusive participation in research activities. By embracing principles of transparency, openness, and reproducibility, prevention science can better achieve its mission to advance evidence-based solutions to promote individual and collective well-being.